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Abstract 

We discuss the non-thermal leptogenesis in the scheme of 5D orbifold SO(IO) GUT 
with the smooth hybrid inflation. With an unambiguously determined Dirac Yukawa 
couplings and an assumption for the neutrino mixing matrix of the tri-bimaximal from, 
we analyze baryon asymmetry of the universe via non-thermal leptogenesis in two typ- 
ical cases for the light neutrino mass spectrum, the normal and inverted hierarchical 
cases. The resultant baryon asymmetry is obtained as a function of the lightest mass 
eigenvalue of the light neutrinos, and we find that a suitable amount of baryon asym- 
metry of the universe can be produced in the normal hierarchical case, while in the 
inverted hierarchical case the baryon asymmetry is too small to be consistent with the 
observation. 
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The so-called renormalizable minimal SO (10) GUT model has been paid a particular 
attention, where two Higgs multiplets {10 ©126} are utilized for the Yukawa couplings with 
matters 16j [i = 1, 2, 3 is the generation index) [U [21 E]- A remarkable feature of the model 
is its high predictive power for the neutrino oscillation parameters, in reproducing charged 
fermion masses and mixing angles. The unambiguously determined Yukawa couplings play 
a crucial role for predictions of the model in other phenomena, such as the lepton flavor vio- 
lation [4j and proton decay [5]. The Higgs superpotential of the model has been investigated 
and the explicit pattern of the SO(IO) gauge symmetry to the standard model one has been 
shown [HI E]. On the other hand, the explicit representation of intermediate energy scales 
revealed in these papers gives rise to the deviation of gauge coupling unification [S]. Also 
the minimal SO(IO) model likely predict too short proton lifetime and has some deviation 
from the precise measurements of the neutrino oscillation data [9] (see however [TO]). 

In order to remedy these problems, we have argued SO(IO) GUT in the context of the 
orbifold GUT [HI [T21 [131 [IH [IS] and proposed a simple supersymmetric (SUSY) SO(IO) 
model in 5D [TB]. In this model, the SO(IO) symmetry in 5D is broken by orbifold boundary 
conditions to the Pati-Salam (PS) symmetry SU(4)cX SU(2)LxSU(2)ij. All matter and 
Higgs multiplets reside only on a brane (PS brane) where the PS gauge symmetry is manifest, 
so that low energy effective description of this model is nothing but the PS model in 4D with a 
special set of matter and Higgs multiplets. At energies higher than the compactification scale, 
the Kaluza-Klein (KK) modes of the bulk SO(IO) gauge multiplet are involved in the particle 
contents and in fact, the gauge coupling unification was shown to be successfully realized by 
incorporating the KK mode threshold corrections into the gauge coupling running [16]. The 
unification scale (Mgut) and the compactification scale (Mc) which was set to be the same 
as the PS symmetry breaking scale (fps) for simplicity were found to be Mqut = 4.6 x 10^'^ 
GeV and = fps = 1-6 x 10^^ GeV, respectively. 

More recently, it has been shown [T7] that this orbifold GUT model is applicable to the 
smooth hybrid inflation [18] . Interestingly, this inflation model can fit the WMAP data [19] 
very well by utilizing the PS breaking scale (vps) and the gauge coupling unification scale 
predicted independently of cosmological considerations. Another cosmological issue, the dark 
matter candidate of the model has been investigated in [20j. In the paper, the sparticle mass 
spectrum is calculated in the context of the gaugino mediated supersymmetry breaking 
which can be naturally incorporated in the model and it has shown that the neutralino LSP 
as the dark matter candidate can be realized when the compactification scale is taken to 
be slightly bigger than the PS symmetry breaking scale, while keeping the successful gauge 
coupling unification. 

In the present paper, we apply our model to the leptogenesis scenario for creating the 
baryon asymmetry of the universe. In order to produce a suitable amount of the baryon 
asymmetry of the universe in the thermal leptogenesis scenario [22] , the scale of right-handed 
(scalar) neutrino masses should be grater than 10^ GeV [23] and hence the reheating temper- 
ature after inflation should also be beyond this scale. However, in supersymmetric models, 
the reheating temperature is severely constrained by Big Bang Nucleosynthesis (BBN) to 
be Tr < 10^ GeV [2l] (gravitino problem [25]), and the conventional thermal leptogenesis 
scenario cannot work. 
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In this case, we consider the so-called non-thermal leptogenesis [26] in which the right- 
handed (scalar) neutrinos are non-thermally produced by the decay of inflaton and their 
decays can produce a suitable amount of baryon asymmetry of the universe even if the 
reheating temperature is low. We adopt the non-thermal leptogenesis to our hybrid inflation 
scenario [I7j and show that the non-thermal leptogenesis is successful with a suitable choice of 
the model parameters which are consistent with the results in the previous works p ^ [T7 t l20]. 

Let us begin with a brief review of the orbifold SO(IO) GUT proposed in Ref. [16]. The 
model is described in 5D and the 5th dimension is compactified on the orbifold / Z2 x Z'2 
[TT] IT^ 113]. A circle with radius R is divided by a Z2 orbifold transformation y — )■ —y 
{y is the fifth dimensional coordinate < y < 2ttR) and this segment is further divided 
by a Z'2 transformation y' — )■ —y' with y' = y + 7tR/2. There are two inequivalent orbifold 
fixed points aX y = and y = ttR/2. Under this orbifold compactification, a general bulk 
wave function is classified with respect to its parities, P = ± and P' = ±, under Z2 and Z2, 
respectively. 

Assigning suitable parities {P,P') to the bulk SO(IO) gauge multiplet [16j, only the PS 
gauge multiplet has zero-mode and the bulk 5D N=l SUSY SO(IO) gauge symmetry is 
broken to 4D N=l supersymmetric PS gauge symmetry. All vector multiplets has wave 
functions on the brane at y = 0, SO(IO) gauge symmetry is respected there, while only the 
PS symmetry is on the brane at y = ttR/2 (PS brane). 





brane at y = 7tR/2 


Matter Multiplets 


tP, = Fu®F'^^ (^ = 1,2,3) 


Higgs Multiplets 


(1,2,2)h, (1,2,2)^, (15,1,1)^,, (6,1,1)^^ 
(4,1,2)h, (4,1,2)^, (4,2,1)^,, (4,2,1)^, 



Table 1: Particle contents on the PS brane. Fu and F^^ are matter multiplets of i-th 
generation in (4, 2, 1) and (4, 1, 2) representations, respectively. 

We place all the matter and Higgs multiplets on the PS brane, where only the PS sym- 
metry is manifest, so that the particle contents are in the representation under the PS gauge 
symmetry, not necessary to be in SO(IO) representation. For a different setup, see [27]. The 
matter and Higgs in our model is listed in Table 1. For later conveniences, let us introduce 
the following notations: 

= (1,2,2)^,, if( = (1,2,2)'^, 
He = (6,1,1)^^, ^5 = (15,1,1)h, 
Hl = (4,2,1)h, lh=^4,2,l)H, 
= (4,1,2)h, 0=(4,1,2)^,. (1) 
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Superpotential relevant for fermion masses is given bj|f] 



+ -^n^^,,m. (2) 

where M5 is the 5D Planck mass. The product, H[Hi^, effectively works as (15, 2,2)j:/, 
while 00 effectively works as (10,1,3), and is responsible for the right-handed Majorana 
neutrino masses. Assuming appropriate VEVs for Higgs multiplets, fermion mass matrices 
are obtained, which we parameterize as the following form |16j : 

M„ = CioMi,2,2 + Cl5Mi5,2,2 , 

Md = Mi,2,2 + Mi5,2,2 , 

Md = CioMi,2,2 - 3Ci5Mi5,2,2 , 

Me = Mi,2,2 - 3Mi5.2,2 , 

Mr = CrMw,1,3 . (3) 

Here, M^, M^, Md and Me are the mass matrices of up and down type quarks, Dirac neutrino 
and charged lepton, respectively, while Mr is right-handed Majorana neutrino mass matrix. 
The following two points should be remarked: 

1. The combination of two mass matrices of Mi 2,2 and Mi5_2,2 among M„, M^, M^, and Me 
in the PS symmetry is the same as that of Mio and M126 in the minimal SO(IO) model (see 
[3] for notation) and, therefore, the procedure for fitting the realistic Dirac fermion mass 
matrices is the same as in the minimal SO(IO) model. 

On the other hand, 

2. Mr is fully independent on the above four Dirac Fermion mass matrices in the PS group, 
whereas in the minimal SO(IO) model it is described by M126 and not independent. This 
fact enables us to improve the precise data fitting on the neutrino oscillation parameters. 

Now we discuss the smooth hybrid inflation model [18] in the context of the orbifold 
SOflO) GUT model. Introducing a singlet chiral superfield S, we consider the superpoten- 
tiafl 

(4) 

where A is a dimensionless coefficient, /i is a dimensionful parameter, and M5 is the 5D 
Planck mass. SUSY vacuum conditions lead to non-zero VEVs for (0) = (0) = y/ fiM, by 
which the PS symmetry is broken down to the SM one, and thus 



VPS 



(5) 



For simplicity, we have introduced only minimal terms necessary for reproducing observed fermion mass 
matrices. 

The renormalizable term, 5(00), can be forbidden by introducing a discrete symmetry |18| . for example, 

6 — > —6 and 6^6. 
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It is theoretically natural to identify M5 as the GUT scale, M5 ~ Mqut- From the analysis 
of the gauge coupling unification in the context of the 5D orbifold GUT [16], we found that 
fps = 1.2 X 10^^ GeV and Mqut = 4.6 x 10^'^ GeV. Independently of the analysis of the 
gauge coupling unification, it has shown in [T^ that this smooth hybrid inflation model, 
where the inflation trajectory is approximately parameterized by the scalar component of S, 
can reproduce the WMAP data by vps = 1.2 x 10^^ GeV and M5 being the the same order 
of magnitude as Mgut. 

Now we discuss the main topic of this paper: the non-thermal leptogenesis. The relevant 
part of the superpotential is 

\2- 



w = xs 



Ml 



R rpc rpc 



(6) 



where without loss of generality, we work on the mass diagonal basis of the right-handed 
neutrinos. The infiaton which is the scalar component of S couples with the scalar right- 
handed neutrinos in the scalar potential, 

2 



V D 



dW 


2 


dcj) 





\s 



Ml 



Rt^ Ri\ 



(7) 



Parameterizing the infiaton field o = \/2^[S], 



the infiaton mass is found to be 



and the interaction between the infiaton and the scalar right-handed neutrinos 

2 



int 



M,a(F^,F]^, + h.c. 



(9) 



where Mj = 2Y^{vp^/M^) is mass of the (scalar) right-handed neutrino of the i-th generation, 
and we set Mi < M2 < M3 without loss of generality. The partial decay width of the infiaton 
into the i-th generation scalar right-handed neutrino, if kinematically allowed, given by 

r2 / \ 4 



^ ' 2'Km„ \ M5 



(10) 



Here iVj denotes the scalar right-handed neutrino in the i-th generation. Since the infia- 
ton and the superfields, and 0, have the same mass, the infiaton cannot decay into the 
superfields. 

In non-thermal leptogenesis, the infiaton decays into (scalar) right-handed neutrinos and 
then, the CP-violating decay of the neutrinos generates lepton asymmetry of the universe, 
which is finally converted into baryon asymmetry via the sphaleron processes. The resultant 
baryon asymmetry of the universe is evaluated as 

10 ^ i un.. 



V s 



X 



31 

10 3 
— X - 
31 2 



Tr 



:iii 
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Figure 1: The mass spectrum of the scalar right-handed neutrinos as a function of mo (sohd 
hues) in the normal hierarchical case for the light neutrino mass spectrum. The dashed like 
represents mo-/2. 



where the sum is taken to be scalar right-handed neutrinos kinematically allowed, and the 
CP-violating parameter is given by [28] 

= ' E I- mm (12) 

with the Dirac neutrino Yukawa coupling Yi, and 

fix) ^ v^lnfi±^')+2^. (13) 
\ X J X — I 

Here we have assumed that masses of all scalar right-handed neutrinos are greater than 
the reheating temperature after inflation. This assumption is crucial because if a scalar 
right-handed neutrino is lighter than the reheating temperature, the scenario becomes ther- 
mal leptogenesis and the baryon asymmetry produced is not enough for a low reheating 
temperature. 

For the prediction of the resultant baryon asymmetry, we need the information of the 
Dirac Yukawa coupling, the mass spectra of the scalar right-handed neutrinos and light 
neutrinos, and the neutrino mixing matrix. Through the seesaw mechanism [2S], the light 
neutrino mass matrix is given by 



in the basis where the mass matrix of charged lepton is diagonal. Here Vu is the VEV of the 
up-type Higgs doublet, Mr is the mass matrix of the right-handed neutrinos, and is the 
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Figure 2: The reheating temperature as a function of mo in the normal hierarchical case. 



diagonal mass matrix of light neutrinos. In this paper, we consider two typical cases for the 
light neutrino mass spectrum and describe Dy in terms of the lightest mass eigenvalue mo 
and the mass squared differences: 



Dy = diag ^mo, Amj^ + mg, ^ Amj^ + mg^ 



(15) 



for the normal hierarchical case, and 



Dy = diag J Am^3 + ml, J Am\2 + Am\^ + ml, mo 



(16) 

for the inverted hierarchical case. Here we adopted the neutrino oscillation data |30] : 

2.43 X 10"^ eV^ (17) 
In addition, we assume the mixing matrix of the so-called tri-bimaximal form [31] 

( .fl .fl \ 



Ami2 



7.59 X 10"^ eV^ Am^g 



U 



MNS 



\ 



(18) 



2 / 



which is in very good agreement with the current best fit values of the neutrino oscillation 
data |30] . As we mentioned above, the data fit for the realistic Dirac mass matrices of the 
present model is the same as in the minimal SO(IO) model, and as an example, we here use 
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Figure 3: The resultant baryon asymmetry produced via non-thermal leptogenesis as a 
function of rriQ (solid line) in the normal hierarchical case. The dashed line represents the 
observed value Yb = 0.87 x 10"^°. 



the numerical value Y^, obtained in [3j at the GUT scale usual in 4D models ~ 10^^ GeV for 
tan f3 = 45: 

/ -0.000135 - 0.00273i 0.00113 + 0.0136i 0.0339 + 0.0580i \ 
Y^=l 0.00759 + 0.0119i -0.0270 - 0.00419i -0.272 - 0.175i . (19) 
\ -0.0280 + 0.00397i 0.0635 - 0.0119i 0.491 - 0.526z / 

In this way, we can obtain the (scalar) right-handed neutrino mass matrix as a function of 
mo, 

Mn = vl {YMiNsD-'ulj^syj) (20) 

with Umns assumed to be the tri-bimaximal mixing matrix. 

Now we are ready to analyze the baryon asymmetry produced in the model. Once the 
parameters in the smooth hybrid inflation. A, fps and M5, are fixed, the baryon asymmetry 
of the universe of Eq. ( |TT|) is calculated as a function of only mo, providing the reheating 
temperature evaluated as 



^■«=(i^)'v^. pi) 

which is also a function of mg. Here F is the total decay width of the infiaton, Mpi = 1.2 x 10^^ 
GeV, and ~ 200. 

In our analysis, we take vps = 1.2 x 10^® GeV and M5 = 4.6 x 10^^ GeV according to 
the values found in [TB] which realize the gauge coupling unification. As an example, we fix 
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Figure 4: The same as Fig. 1 but for the inverted hierarchical case. 



A = 0.02. For these parameters fixed, Fig. 1 shows the mass spectrum of the scalar right- 
handed neutrinos as a function of mo, together with mo-/2, in the normal hierarchical case. 
For mo ^0.1 eV, the infiaton decays into only a pairs of the scalar right-handed neutrinos 
in the first generation. 

The reheating temperature as a function of mo is depicted in Fig. 2. The jump around 
mo ~ 0.1 eV is because the decay channel of infiaton into the scalar right-handed neutrino 
in the second generation is opened up there and the reheating temperature becomes higher 
than Ml, Tr > Mi, so that we exclude the region mo > 0.1 eV in our analysis. 

In Fig. 2, the reheating temperature exceeds its BBN bound Tr < 10^. However, this 
bound is not applicable if the gravitino is heavy, 171^/2 > 100 TeV, in which case gravitino 
in the early universe decays before BBN takes place. As has been investigated in [20], the 
gaugino mediated supersymmetry breaking is naturally incorporated in our 5D SO(IO) GUT, 
where SUSY breaking is assumed to occur on the brane at y = and the SO(IO) gaugino 
residing in the bulk directly couples with the SUSY breaking sector, 

C = Cg6{y) I <fe ^tr , (22) 

where X is a singlet chiral superfield which breaks SUSY by its F-component VEV {Fx}-, 
and Cg is a dimensionless constant. Then, the gaugino obtains the SUSY breaking soft mass, 

= c,^M. ^ c,— J ^ c,m3/, ^— J , (23) 

where the compactification scale comes from the wave function normalization of the bulk 
gaugino, we have used the relation between the 4D and 5D Planck masses, Mp ~ M|/Mc 
with the reduced Planck mass Mp = 2.4 x 10^^ GeV, and m3/2 — Fx/Mp is gravitino mass. 
In this paper we adopt Cg < 0.1, so that m3/2 > 100 TeV for m\ ~ 100 GeV. 
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Figure 5: The same as Fig. 2 but for the inverted hierarchical case. 



Finally, in the normal hierarchical case for the light neutrino mass spectrum, we show 
the resultant baryon asymmetry of the universe generated via the non-thermal leptogenesis 
as a function of itlq in Fig. 3, together with the currently observed value [19] 

Yb = — = 0.87 X 10-1°. (24) 
s 

We find the observed value is reproduced for rriQ ~ 1.8 x 10~^ eV. 

We repeat the same analysis for the inverted hierarchical case. Fig. 4 shows the mass 
spectrum of the scalar right-handed neutrinos, and the reheating temperature is depicted 
in Fig. 5. The resultant baryon asymmetry is shown in Fig. 6 as a function of mo. We 
find that in the inverted hierarchical case the baryon asymmetry produced in non-thermal 
leptogenesis is too small to be consistent with the observation. 

In summary, we have studied the non-thermal leptogenesis in the scheme of 5D orbifold 
SO(IO) GUT with the smooth hybrid inflation. With an unambiguously determined Dirac 
Yukawa couplings and an assumption for the neutrino mixing matrix of the tri-bimaximal 
from, we have analyzed the baryon asymmetry of the universe via non-thermal leptogenesis in 
two typical cases for the light neutrino mass spectrum, the normal and inverted hierarchical 
cases. The resultant baryon asymmetry is given as a function of the lightest mass eigenvalue 
of the light neutrinos mo. In the normal hierarchical case, for mo — 1.8 x 10~^ eV, the model 
predicts a suitable amount of the baryon asymmetry through non-thermal leptogenesis, while 
in the inverted hierarchical case, the predicted asymmetry is too small to be consistent with 
the observations. As can be seen from Eqs. flTU]) and fl2T]) . a mildly small A guarantees 
Ml ^ Tfi and this is crucial for the realization of non-thermal leptogenesis where we can 
neglect wash-out processes. 

Our 5D orbifold SO(IO) GUT was originally constructed in order to remedy problems 
of the minimal SO(IO) GUT in particle physics. It is very interesting that the parameters 
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Figure 6: The same as Fig. 3 but for the inverted hierarchical case. 



determined from particle physics give the consistent observational values of WMAP coming 
from quite different origins of cosmology. Leptogenesis may be placed just in the midst 
of particle physics and cosmology among others and is very sensitive to the parameter of 
particle physics. Our theory is consistent with it, giving additional constraints on the lightest 
neutrino mass. 
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